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Abstract. The subset sum problem (SSP) can be briefly stated as: given 
a target integer E and a set A containing n positive integer a-j, find a 
subset of A summing to E. The density d of an SSP instance is defined by 
the ratio of n to m, where m is the logarithm of the largest integer within 
A. Based on the structural and statistical properties of subset sums, 
we present an improved enumeration scheme for SSP, and implement it 
as a complete and exact algorithm (EnumPlus). The algorithm always 
equivalently reduces an instance to be low-density, and then solve it by 
enumeration. Through this approach, we show the possibility to design 
a sole algorithm that can efficiently solve arbitrary density instance in a 
uniform way. Furthermore, our algorithm has considerable performance 
advantage over previous algorithms. Firstly, it extends the density scope, 
in which SSP can be solved in expected polynomial time. Specifically, It 
solves SSP in expected 0(n log n) time when density d > c ■ y'n/logn, 
while the previously best density scope is d > c- n/(logn) 2 . In addition, 
the overall expected time and space requirement in the average case are 
proven to be 0(n log n) and 0(n ) respectively. Secondly, in the worst 
case, it slightly improves the previously best time complexity of exact 
algorithms for SSP. The worst-case time complexity of our algorithm is 
proved to be 0(n ■ 2 n / 2 — c ■ 2 n//2 + n), while the previously best result is 
0(n-2 n/2 ). 

1 Introduction 



Let us denote N+ as the set of positive integers. The subset sum problem is a 
classical NP-complete problem, in which one asks, given a set A = {a%, a2, a n } 
with a,j 6 N+ (1 < j < n) and E 6 N+, if there exists a subset A' C A such that 
the sum of all elements of A 1 is E. More formally, the subset sum problem can 
be formulated as an integer programming problem: 

n 

Maximize z = ^ djXj 

n 

Subject to ^2 cijXj < E;\/j, Xj = or 1. 

3=1 



Extensive study has been conducted on SSP and its related problems: knapsack 
problem [1] and integer partition problem [2] . Many noticeable results have been 
achieved. For example, the hardness distribution of those problems are carefully 
investigated in [2] [3] [4] [5] et al. , and it is now known that the hardness of SSP 
varies greatly with density d (see [6]). 

Low-density: an instance with density < d < c, for some constant c, can be 
efficiently solved by lattice reduction based algorithms, e.g., [7] [8] [9]. However, 
these algorithms have two main limits. Firstly, they cannot solve instance with 
d > c efficiently, though the bound of constant c is recently extended from 0.6463 
to 0.9408. Secondly, they are not complete, i.e., they may fail to find any solution 
of an instance when the instance actually has solution. 

High-density: an instance with density d > c ■ n/logn can be efficiently 
solved by various techniques such as branch-and-bound, dynamic programming, 
and number theory analysis. Specifically, the algorithm YS87 [10] adopts branch- 
and-bound technique; NU69 [11] and HS74 [12] adopt dynamic programming 
technique; ST02 [13] adopts both branch-and-bound and dynamic program- 
ming; CFG89 [14] and GM91 [15] utilize number theory analysis. However, 
these algorithms have two main limits. Firstly, they cannot solve instance with 
d < c • nj logn efficiently. Secondly, their average-case complexity is expected to 
increase with n, thus they have difficulty in handling large size instance. 

Medium-density: an instance with density c < d and d < c ■ n/logn is 
usually hard to solve. As far as we know, the algorithm DenseSSP [6] is the 
only previous algorithm that works efficiently in part of this density scope. It 
solves uniformly random instances with density d > 16n/(logn) 2 in expected 
polynomial time 0(n 3 / 2 ). 

Other than exact algorithms, it is worth to mention that highly efficient 
approximation methods (e.g., [16] [17]) can solve SSP at polynomial time and 
space cost. However, they cannot guarantee the exactness of their solutions. 
In this paper, we concentrate on solving SSP through exact methods, and we 
propose a complete and exact algorithm, which we call EnumPlus. The two main 
ingredients of EnumPlus are a new pruning mechanism and a new heuristic. 
Based on the structural property of subset sums, the pruning mechanism allows 
to dynamically partition the integer set into two parts and to prune branches in 
the search tree. Based on the statistical property of subset sums, the heuristic 
predicts which branch of the tree is more likely to contain the solution (and this 
branch is explored first by the algorithm). 

1.1 Contributions 

The main contribution of this work is two-fold. First, by equivalently reducing 
an instance to be low-density in linear time (see Section 4 and 6.2), we show the 
possibility to design a sole algorithm that can efficiently solve arbitrary density 
instance in a uniform way. Second, we propose a complete and exact algorithm 
that has considerable advantage over previous exact algorithms. Specifically, it 
extends the density scope, in which SSP can be solved in expected polynomial 



time, and it slightly improves the previously best worst-case time complexity of 
exact algorithms for SSP. 

1.2 Notation and Conventions 

If it is not specifically mentioned, we assume that the elements of A are sorted in 
decreasing order (en > <Z2 > .. > a n ), and use S to denote the sum of A. Following 
the notation and description style of [1], we denote some basic notations that 
are used for the algorithm description as follows: 

Ak denotes the subset {a/,, a k +i, ..,a„} of A; 



W{E) denotes the number of solutions for a given target E and integer set A; 
£k denotes current partial solution {xj = 0, 1|1 < j < k}; 



fife denotes current residual capacity (= E — z k ); 

^C/t denotes current residual opposite capacity (= S k +i — c k ); 

i>MAx \ (Ak,Ck) denotes the maximum subset sum of Ak while buAX < c k ; 

^min \ (Ak,c k ) denotes the minimum subset sum of A k while &m/jv > c k . 

2 Motivation 

There are two main causes of performance discrepancy of different enumeration 
(searching) scheme. In the first place, the efficiency to prune infeasible solutions 
contributes to the performance both in the worst case and in the average case. In 
the second place, proper search strategy contributes to the performance in the 
average case. Specifically, algorithm HS74 has the best time complexity 0(n ■ 
2 n / 2 ) in the worst case. It enumerates all possible solutions following breadth 
first strategy; it prunes redundant branches by dividing the original problem into 
two sub-problems and considering all equal subset sums as one state. However, 
HS74 does not work well in two situations. Firstly, when processing low-density 
instance, almost all subset sums are different to each other, thus few pruning 
can be made. Secondly, because of its breadth-first search strategy, HS74 is slow 
to approach solutions when the size, i.e. breadth, of an instance is considerable 
large. 

The central idea of our approach is dynamically partitioning the original 
instance A[l..n] to two sub-instances A[l..fc] and A[k + l..n], 1 < k < n. We treat 
the whole enumeration space as a binary tree (like the route colored by red in 
Figure 1) that is stemmed from A[l] and ended by A[n\. During the enumeration 
of A[l..n], all enumerated subset sums of A[k + l..n] are organized as "block 
bounds" , which serve as block barriers that can prevent further expending of the 
fc-th level nodes. Therefore, for any partition point k, both A[l..fc] and A[k+l..n] 
are incrementally and simultaneously enumerated by enumerating A[l..n] as a 





binary tree. In addition, a heuristic is utilized to accelerate the searching for 
global solution. The heuristic predicts which branch of the tree is more likely 
to contain the answer. Therefore, a large problem is recursively reduced into a 
smaller one in linear time, and it has high possibility that the two problems have 
at least one common solution. To clarify the description of our algorithm, wc 
present the main phases separately. 

3 Branch and Prune 

The pruning mechanism is inspired by the partition operation of HS74. In HS74, 
the original instance is divided into two sub-instances, and their subset sums are 
separately computed and stored in two lists. For any subset sum Sj in a list, if 
a subset sum Sj can be found in the other list such that Sj + Sj = E, a feasible 
solution is located. While HS74 explicitly partitions the the oriental instance 
only one time before enumeration, our algorithm implicitly performs partition 
multiple times during enumeration. 

A "block bound" of an integer set A is defined as a two elements structure 
[bMAX ,bMiN], in which buAX and buiN are subset sums of A. Furthermore, a 
block bound must conform two constraints: (1) buAX < &m/jv! (2) no subset 
sum of A falls between buAX and &mjjv- Block bounds are recursively calculated 
as follows: 

If c k > S k , b M iN\(Ak,c k ) = S,b M Ax\(A k ,c k ) = S k . 
If c fe < 0, b M iN\{A kl c k ) = 0, b M Ax\{A kl c k ) = -a k+1 . 



Let us consider a sorted integer array A[l..n], we create an n elements list y[l..n]. 
Each element V[k] of V [l..n] is a collection of block bounds of the integer set A k . 
Therefore, if there is an integer s = buAX (or &mijv)> ^max^m/w] € V[k + 1], 
and s + z k = E, a feasible solution for target integer E is located. If there is 
a block bound [6max, &m/jv] € V[k + 1] such that buAX < c k < b M iN, we 
can determine that there is no subset sum s of A k+ \ such that s + z k = E. 
In this way, a block bound \t>MAX , bui n] of A k acts as a bounded block that 
prevents all attempts to find target E in A k when 6m ax < E < 6m/jv- To 
describe the mechanism of block bound, a case that has an integer set A[1..4] = 
{52, 40, 30, 16} and the target value E = 69 is illustrated in Figure 1. 

As we can see in Figure 1, the first node c\ = 69 is expended to two nodes 62 = 
{69, 17}, i.e., finding E = 69 and 17 in subset ^4[2..4]. Suppose the node having 
larger E is always expended first, the first block bound [16, 138] is generated 
when finding E — 69 in subset A[4..4]. Therefore, later finding of E = 39,29 
in subset A[4..4] is blocked by the block bound [16, 138] . In the same way, let 
us observe the case of k = 3, the searching for 63 = 29 is finished with the 
generation of a block bound [16, 30], and the later searching for 63 = 17 will be 
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Fig. 1. The generation of block bounds for target value E = 69 and integer set ^4[1..4] = 
{52,40,30,16}. 



blocked by the block bound [16,30]. When the enumeration is finished, 6 block 
bounds {[68, 70], [16, 30], [56, 70], [16, 30], [46, 138], [16, 138]} are generated. 



4 Heuristic Search Strategy 



Instead of pure depth-first or breadth-first search strategy, we introduce a new 
heuristic to accelerate the approach to feasible solution. At each state of enumer- 
ation, the expanding branch that has larger possibility to find feasible solution 
will be explored first. The heuristic is inspired by a previous study result of [3] 
in the context of canonical ensemble, which is usually studied in the physics 
literature. The main purpose of [3] is to study the property of the number 
of solutions in SSP, and then explain the experiential asymptotic behavior of 
W(E). As [3] suggested, given uniformly random input integer set A and target 
value E, the number of solutions W(E) is a central symmetric function with 
central point at E = S/2. Moreover, W(E) monotonically increases with the 
increase of E in [0, S/2] . If we denote Pr[i?] as the possibility of that there ex- 
ists at least one solution of E, given two target value E\ and E2, we have that 
Pr[£i] > Pr[E 2 ] iff \S/2 ~E 2 \> \S/2 - E x \. Suppose current partial solution is 
Xk, weather x k +i = 1 (i.e. c k +i = c k - a k+ i) or x k+ i = (i.e. c k+1 = c k ) should 
be tried first is decided by the inequation: 



ncfe + c fc )/2 - (c fe - a k+1 )\ > \(->c k + c fe )/2 -c k \. 



(1) 



Thus, we obtain the new heuristic: if inequation (1) holds, try x k +\ = first, 
otherwise, try x k +\ = 1 first. 



5 The New Algorithm 



Based on the "block bound" and "heuristic search" techniques, we propose a 
complete and exact algorithm EnumPlus for SSP. In this algorithm, the whole 
search space is enumerated as a binary tree T . For any given target value v at a 
branch node, the algorithm try to find both bMAx \ {Ak, v) and 6m/jv| {Ak,v) in 
the sub-tree Tk that has Xk as root node. If the block bound is already existed 
in the block bound list V[k], the existed block bound will be returned. Oth- 
erwise, Tfc is expended to find the block bound [&max| (Ak,v) ,bMiN \ {Ak,v)], 
and the newly found block bound is inserted into V[k] as a new element. The 
enumeration procedure terminates in 2 cases: I) a feasible solution is found, 2) 
it is backtracked to the root of T. At each branch node (xk) of T, if the target 
value v is more possible to be found when Xk = 0, then the branch Xk — is 
enumerated first, otherwise the branch Xk = 1 is enumerated first. 

The pseudo-code of EnumPlus and SetSum are given in Algorithm I and 
Algorithm 2 respectively, while the concrete implements of sub-algorithms QBB 
and UBB are not given since they can be implemented by simply adopting 
some classic data structures/algorithms (e.g., AVL-balance tree and Red-Black- 
balance tree). 



Algorithm 1 EnumPlus(A[1..7V], E) 
Input: an integer set j4[l..iV]; target value E. 

Output: the maximum subset sum 61 < E; the minimum subset sum b2 > E. 
1: allocate the vector of block bound sets V[1..AT|; 
2: S<= sum value of A[1..N]; 
3: [61,62] SetSum(l,£); 

4: destroy the vector of block bound sets V[1..N]; 
5: return [61,62]; 



6 Performance Analysis 

Before analyzing the complexity of our algorithm, we assume that the require- 
ment of time and space of our algorithm is maximized when target value E = 
S/2. The assumption is reasonable because our algorithm simultaneously search 
both E and S — E in the answer space. Moreover, E = S/2 is the hardest case 
for the dynamic programming algorithm (see [15]). Therefore, all our following 
analysis will be provided in case of that 5/2 is chosen as target value E. 

6.1 Worst-Case Complexity 

Before the presentation of our results about the worst-case complexity of EnumPlus, 
wc first introduce a lemma as follows: 



Algorithm 2 SctSum(/c, v) 



Input: k — start position of residual subset A[fc..n]; 

v — residential capacity c. 
Output: [bMAx,bMiN] = block bound of A[k..N] for c = v. 

1: if w > Sfc return [5 fc ,S]; 

2: if v < return [— Ofc+i,0]; 

3: [&max,&mjjv] QBB(V[fc],w); // query block bound [6max,6mjat] in V[k] such 

that 6 M ix < v < b M iN- 
4: if b M Ax < v < b M iN then 
5: if v = buAx or» = buiN then 
6: identify solution; halt; // found solution 
7: else 

8: return [b M Ax, 6m/at]; 
9: end if 

10: else if inequation 1 holds then 
11: [63,64]«=SetSum(fc + l,i>); 

12: [61, 62] SetSum(fc + 1, w - A[fc]); 61+ = A[fe]; 62+ = A[% 
13: else 

14: [61, 62] <= SctSum(fc + l,v- A[k],v2); 61+ = A[k]; 62+ = A[fc]; 
15: [63,64] SetSum(fc + l,v); 
16: end if 

17: bMAx <= max{61, 63}; buiN <= min{62, 64}; 

18: XJBB(V[k],bMAx,b M iN); // insert [b M Ax,b M iN] into V[k] 

19: return [b M Ax,b M iN]; 



Lemma 1. For a certain subset A[k..n] of A, the number of block bounds gen- 
erated by SetSum is less than min{2 k ~ 1 , 2 n ~ k+1 }. 

Proof. In case of 2 fe ~ 1 > 2 n_fe+1 , the number of all possible subset sums of 
A[k..n] is less than (2 n ~ k+1 — l), therefore the number of all possible block 
bounds of A[k..n] is less than 2™- fe+1 , i.e. mira^" 1 , 2 n " fe+1 }. In case of 2 k - 1 < 
2 n_fe + 1 , the search tree has at most 2 fc_1 nodes at level k. Because each node 
generates at most one block bound, the number of all possible block bounds of 
A[k..n] is less than 2 k ~\ i.e. min{2 k -\ 2"- fc+1 }. 

About the worst-case complexity of EnumPlus, there are 2 propositions given 
as follows: 

Proposition 2. The worst-case space complexity of EnumPlus is 0(2™/ 2 ). 

Proof. For a subset A k , the number of block bounds generated by SetSum is less 
than min{2 fc_1 , 2™~ fc + 1 }, therefore the total number Num(n) of generated block 
bounds is 

n n/2 

Num(n) < ^min{2 fe - 1 ,2"- fe+1 } < 2 x^2^ < 2"/ 2+1 . 
fe=l k=l 

Thus the worst-case space complexity of EnumPlus is 0{2 n / 2 ). 



Proposition 3. The worst-case time complexity of EnumPlus is 0(n- 2™/ 2 — c- 
2"/ 2 + n). 

Proof. As we proved in the proposition 2, there are at most 2™ //2+1 block bounds 
are generated, and each recursive call for SetSum generates one block bound. The 
main time cost of each block bound is to search and insert it in a collection V[k\. 
There are some classic data structures/algorithms, such as AVL-balance tree and 
Red-Black-balance tree, can efficiently manage the search and insert operations 
on storable data collection. The worst-case time cost of these algorithms to search 
or insert in the n elements collection is logn. Therefore we have the worst-case 
time cost Time(n) of EnumPlus as follows: 

n/2 2 k - 1 n/2 k 

Time(n) - 2 x £ £ l^gi] = 2 x £ £ ((* - 1) x 2<" 2 ) 

fc=l i=l fc=l i=l 

n/2 

= 2x J2 (( fc - 2 ) x 2 fc - 1 + l) 

k=l 

< (n - 6) x 2™/ 2 + n + 8 

Thus the worst-case time complexity of algorithm EnumPlus is 0(n ■ 2 n l 2 — c • 
2"/ 2 + n). 



6.2 Average- Case Complexity 

Before analyzing the average-case complexity of our algorithm, 2 lemmas are 
introduced as follows: 

Lemma 4. EnumPlus always reduces an instance A\ with c\ = S\/2 to Ak with 
c-k, \ck — Sfc/21 < ak-i/2, in linear time. 

Proof. [Induction] We first consider k — 2. Because of the heuristic search 
strategy, EnumPlus first expends the branch that leads to a sub-problem, in 
which \dk — Sfc/2| is smaller. Then we have 

Si/2,if|6 , i-S , 2 | < |5i -2oi -S 2 \ 
S 1 /2-a 1 ,ii\S 1 -S 2 \ > |5i-2oi-5 2 |. 



C2 ; 

Therefore, 

C2 - S 2 /2 



ai/2,if|Si-S 2 | < |5i-2ai-5 2 | 
-ai/2,if|Si-S 2 | > |Si-2ai-5 2 | 



Thus EnumPlus reduces A\ with ci = S\/2 to A 2 with c 2 , |c 2 — 5*2/21 < ai/2, 
in 1 step. 

Then we assume that EnumPlus reduces A\ with ci = S\/2 to with Ck, 
|cfc — 5^/21 < afc_i/2, in fc — 1 steps. 
Consider and Cfe+i, we have 

{Cfe,if |c£ — Sfe+il < |cfc — 2afe + i — Sfc+il 
c fe - a kl \i\c k - S k +i\ > |cfc - 2a fc+ i - . 



Combine the above definition of dk+i and the assumption that |cfc — 5fc/2| < 
afe_i/2, we have that \ck+i — Sfc+i/2| < afc/2. Thus EnumPlus reduces Ai with 
ci = Si/2 to ,4 fe+ i with Cfc+i, |cfe+i - Sfc+i/2| < a k /2, in fc steps. 

Lemma 5. Let M = 2 m and the n elements of A is uniformly random in [1..M], 
the number of distinct subset sums of A is expected to be 0(n 4 ). 

Proof. We use S\,...,Sm to denote the sequence of all subsets of A listed in 
non-decreasing order of their sums. Let the sum of subset S u be P u — J2jeS u a r 
For any 2 < u < M, define A u = P u — P u -\ > 0, then P u is a distinct subset 
sum if A u > 0, and Pi is always a distinct subset sum. Let every element aj of 
A be a non- negative random variable with density function fj : [1..M] — > [0, 1], 
i.e., fj(t) = Pr(&j — t),t <G [1..M]. We notice that there is a theorem, which is 
proved by [18] for general discrete distributions, shows that: 

Suppose tt — maXj e [i .. n ]( max xe[i..M](fj( x )) an d M > max je[i..n] {^[ a j])- 
Then the expected number of dominating sets is E[q] = 0{jin 2 {l — e -7 ™ 2 )) = 
(M 

Because a distinct subset sum is a special case of dominating set on condition 
that weight Wj and profit pj are both equal to aj , the number of distinct subset 
sums is equal to the number of dominating sets on this condition. Since aj is 
uniformly random in [1..M], we have tt = l/M, [i = M/2. Therefore, the number 
of distinct subset sums is expected to be 

M 1 

m=0{----n i ) = 0{n i ). 

Assume that the elements of A is uniformly random in [1..M], we have 2 
propositions about the complexity of EnumPlus in the average case: 

Proposition 6. Given an integer set A whose elements are uniformly distributed, 
the overall expected time and space requirement of EnumPlus in the average case 
are 0(n 5 logn) and 0(n 5 ). 

Proof. According to Lemma 5, the number of distinct subset sums of A is ex- 
pected to be 0(n 4 ). Therefore the expected space cost is 0(n ■ n 4 ) = 0(n 5 ), and 
the expected time cost is 0(n-n 4 ■ log (n 4 )) = 0(n 5 logn). Thus the overall time 
and space complexity of EnumPlus are expected to be 0(n 5 logn) and 0(n 5 ) 
respectively. 

Proposition 7. EnumPlus solves SSP in O(nlogn) time when density d > 
c ■ y/n/ logn. 

Proof. Consider an integer set A[l..n] whose elements are uniformly random in 
[1..2™ 1 ]. As the previous result shown by [3] and [2], if density d > 1, there is a 
high possibility that the instance with target value 5/2 has many solutions. Thus 
it is expected that the sub-instance A n _ m+ i with S'/ s _ TO+ i/2 has many solutions, 
and it takes at most 0(m2 m l 2 ) time to locate these solutions. Furthermore, as 
we proved in Lemma 4, EnumPlus reduces instance A[l..n] with 5/2 to sub- 
instance Ak with 5fe/2 in linear time. Thus the expected time complexity for 



the problem A with S/2 is 0(m2 m / 2 ) + 0(n). If n = 0(2 m / 2 '), > I > 1, 

then the expected time complexity for instance A[l..n] with S/2 is 0(n J logn), 
and d=0( \/2™/m) = 0{ tyE/logn). Thus EnumPlus solves SSP in O(nlogn) 
time when density d> c • y^n/ logn. 

6.3 Comparison of Related Works 

Among the previously exact algorithms for SSP, HS74 has the best time complex- 
ity 0(n ■ 2 n l' 1 ) in the worst case. EnumPlus is an overall improvement of HS74, 
its worst-case time complexity is 0(n ■ 2"/ 2 — c ■ 2™/ 2 + n). As we described in 
Section 2, HS74 always reduce the original instance to 2 half size sub-instances. 
As we know, if the density of sub- instance is larger than 1 , a solution is expected 
to be found by solving one sub-instance whose size is half of the original instance. 
However, by using a new heuristic, EnumPlus reduce the original instance to a 
smaller sub-instance, in which the solution can be found (see the proof of Propo- 
sition 7). Thus the performance of EnumPlus is better than HS74 in average case, 
especially when handling large size instance. Specifically, EnumPlus solves SSP 
in O(nlogn) time when density d > c ■ \fnj 'logn. This density bound is better 
than the density bound d > c ■ n/(logn) 2 of DcnscSSP, which is the only pre- 
vious algorithm working efficiently beyond the magnitude bound of 0{n/ logn). 
However, it must be noticed that the performance of EnumPlus is still not good 
enough when handling low-density instance. When density d < 0.9408, some 
incomplete algorithms, which are based on lattice reduction, are expected to 
outperform EnumPlus. 

7 Conclusions and Future Work 

In this work, we proposed a new enumeration scheme that utilizes both structural 
property and statistical property of subset sums to improve the efficiency of 
enumeration. The improved enumeration scheme is implemented as a complete 
and exact algorithm (EnumPlus). The algorithm always equivalently reduces 
an instance to be low-density, and then solve it by enumeration. Through this 
approach, we show the possibility to design a sole algorithm that can efficiently 
solve arbitrary density instance in a uniform way. Furthermore, our algorithm has 
considerable performance advantage over previous exact algorithms. It slightly 
improves the previously best time complexity of exact algorithms for SSP in the 
worst case; it extends the density scope to d > c ■ -y/n/ logn, in which SSP can 
be solved in polynomial time. In addition, the overall expected time and space 
requirements are proved to be 0(n 5 logn) and C>(n 5 ) respectively in the average 
case. 

As we previously described, arbitrary density SSP instance can be equiva- 
lently reduced to and solved as low density instance by our approach. Thus the 
efficiency of EnumPlus mainly relics on efficiently solving low density problem. 
Since the lattice reduction approach shows particular efficiency when dealing low 
density instance, the integration of the two approaches may be a potential way 



to further improve the performance of our algorithm. Therefore, the relationship 
between lattice reduction and enumeration scheme is an important issue in our 
future work. 
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